Zhipu AI announces that the LLM GLM-4-Long, which supports ultra-long context lengths, is now available on the open platform bigmodel.cn. This model is designed specifically for processing long texts and can read the equivalent of two copies of 'Dream of the Red Chamber' or 125 papers in one go. It is widely applied in scenarios such as translating long documents, global analysis of financial reports, extracting key information, and building chatbots with ultra-long memory.

iFlytek's Spark has introduced the Spark Pro-128K large model, equipped with ultra-long text processing capabilities, significantly enhancing the value of AI large models in practical applications. The ability to handle long texts is a crucial direction for the development of AI large models, particularly important for industries such as finance, healthcare, and research, enabling rapid understanding and generation of vast amounts of information to improve work efficiency.The API for the Spark P

The internal test of the 360 Smart Brain's 5 million words long text processing feature will be integrated into the 360AI Browser, providing support for various document types. Users will enjoy convenient text processing services on their mobile devices.

Meta has released the Llama2-Long model, which does not increase computational demand when processing long texts while still maintaining excellent performance. The model employs continuous pre-training, improved positional encoding, and data mixing strategies to reduce computational overhead by up to 40%. It performs outstandingly on both long and short tasks, surpassing other long-context models and has the potential to revolutionize the field of natural language processing. The model shows significant improvements in encoding, mathematical, and knowledge-intensive tasks, even surpassing GPT-3.5. The release of the Llama2-Long model provides a powerful solution for handling long texts.

Moonshot AI, released by The Dark Side of the Moon, is the world's first large model to support an input length of 200,000 characters. Yang Zhilin, the founder of Moonshot AI, studied under top AI experts at CMU and is regarded as one of the candidates to be China's local 'OpenAI'. Moonshot AI has achieved breakthroughs in long text processing by optimizing storage, computing power, and network bandwidth, marking the entry of generative AI into the era of long text. Compared to other models, Moonshot AI avoids the 'Whale Model' and the 'Bee Model'.